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Background of the Invention 

Field of the Invention 

[0001] The invention relates generally to audio enhancement systems, 
and more particularly, is directed to spatially enhancing audio for reproduction 
through a speaker. 
Description of the Related Art 

[0002] Many technology devices use a single small speaker to reproduce 
sound. Such devices include, but are not limited to, cellular telephones, personal 
digital assistants (PDA's), laptop computers, television sets, radios, and various 
small hand-held devices. Often such devices have poor audio capabilities and 
because only one speaker is utilized, they are monophonic. Thus, such systems 
often cannot accurately reproduce stereophonic information. 

[0003] True stereophonic reproduction is characterized by at least two 
distinct qualities. The first quality is the directional separation of sound sources to 
produce the sensation of width. Directional separation is generally described as that 
which gives the listener the ability to judge the selective location of various sound 
sources, such as the position of instruments within an orchestra. 

[0004] The second quality is the sensation of depth and presence that the 
directional separation creates. Presence is generally described as the feeling that 
the sounds seem to emerge, not from the reproducing loudspeakers themselves, 
but from positions in between and somewhat behind the loudspeakers. The term 
"ambience" is also used to describe this sensation of width, depth, and/or presence. 

[0005] Attempts to reproduce stereophonic information with monophonic 
systems have included the approach of adding the stereophonic channels together 
with the intent of presenting information from all the channels through a single 
speaker. Unfortunately, merely adding the stereophonic information often results in 
the loss of information. For example, stereo information in one channel may be out 
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of phase with information existing in another channel. When the two channels are 
added together, information is lost due to phase cancellation of the information. 

[0006] Consequently the directional separation and the sensation of depth 
and presence are lost when different channels of stereophonic information are 
combined together using existing methods. 

Summary of the Invention 
[0007] The system and method disclosed herein spatially enhances audio 
for reproduction through a single speaker. The audio enhancement system 
enhances the ambient component of the stereo input signals and mixes the 
enhanced ambient signal with the stereo input signals to produce monophonic audio 
information. 

[0008] In one embodiment, the audio enhancement system generates a 
monophonic output from a pair of input signals. The system combines at least a 
portion of the first input with at least a portion of the second input to isolate 
difference information, enhances the difference information to produce enhanced 
difference information, and combines the enhanced difference information with the 
first and second inputs to generate an enhanced monophonic output. 

[0009] In another embodiment, the audio enhancement system enhances 
the ambient component of the stereo input signals and mixes the enhanced ambient 
signal with the monophonic component of the input signals to produce monophonic 
audio information. 

[0010] In an embodiment, the audio enhancement system generates a 
monophonic output from a pair of input signals. The system combines at least a 
portion of the first input with at least a portion of the second input to isolate 
difference information and combines a portion of the first input with the second input 
to isolate sum information. The system enhances the difference information to 
produce enhanced difference information, and combines the enhanced difference 
information with the sum information to generate an enhanced monophonic input. 

[0011] In other embodiments, the system does not create the sum and 
difference information prior to combining the signals. The mixer isolates the sum 
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and difference information, in addition to combining the enhanced information with 
the sum and difference information. A digital signal processor, for example, can 
implement an audio enhancement system of this type. 

[0012] The stereo input signals are typically a left stereo channel input and 
a right stereo channel input. In addition, the stereo input signals can be synthetically 
generated from a monophonic input signal. 

[0013] The enhancer used to enhance the ambient information comprises 
a filter, a gain, a filter and a gain, a delay, or the like. The characteristics of the 
enhancer may be dependent on the characteristics of the speaker, which 
reproduces the spatially enhanced monophonic audio. 

[0014] In general, different speakers have different characteristics. More 
specifically, different sized speakers have different speaker coefficients. These 
differences accordingly require unique enhancer characteristics to enhance the 
stereo input information that is to be played through the speaker. Depending on the 
enhancer used, the audio enhancement system may need to adjust the phase 
relationship and other properties of the signals. 

[0015] While the enhancer characteristics are dependent upon the 
speaker, the enhancer characteristics can also indicate if the audio enhancement 
system requires phase adjustment. The enhancer can be characterized by its 
magnitude and phase responses. If the magnitude response is approximately 0 dB 
at the frequency where the phase response is approximately 0°, audio information at 
that frequency will be lost when the enhanced signal mixes with the stereo input 
signals. To preserve the potentially canceled audio information, the audio 
enhancement system adjusts the phase relationship of the audio enhancement 
signals. 

[0016] The system enhances the difference information to produce 
enhanced difference information, and phase adjusts the sum information to produce 
phase adjusted sum information. The system combines the enhanced difference 
information with the phase adjusted sum information to generate an enhanced 
monophonic output signal while audio information that potentially would be canceled 
is preserved. 
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[0017] The system can adjust the phase of the difference signal, or the 
system can adjust the phase of both the sum and difference signals. As mentioned 
previously, the sum and difference information need not be isolated prior to mixing 
the signals. The system can adjust the phase of one or both of the input signals and 
produce the sum and difference information in the mixer as intermediate steps. 

[0018] In one embodiment, the phase adjuster adjusts the sum signal. In 
another embodiment, the phase adjuster adjusts the difference signal. In a further 
embodiment, the system phase adjusts both the sum information and the difference 
information. In yet a further embodiment, the system adjusts the phase response of 
the left and right channel input signals. 

[0019] For purposes of summarizing the invention, certain aspects, 
advantages and novel features of the invention have been described herein. It is to 
be understood that not necessarily all such advantages may be achieved in 
accordance with any particular embodiment of the invention. Thus, the invention 
may be embodied or carried out in a manner that achieves or optimizes one 
advantage or group of advantages as taught herein without necessarily achieving 
other advantages as may be taught or suggested herein. 

Brief Description of the Drawings 

[0020] A general architecture that implements the various features of the 
invention will now be described with reference to the drawings. The drawings and 
the associated descriptions are provided to illustrate embodiments of the invention 
and not to limit the scope of the invention. Throughout the drawings, reference 
numbers are re-used to indicate correspondence between referenced elements. 

[0021] Figure 1A is a block diagram of an audio enhancement system for 
generating an enhanced monaural image from a pair of stereo input signals, 
according to an embodiment of the invention. 

[0022] Figure 1B is a block diagram of an audio enhancement system for 
generating an enhanced monaural image enhancement from a pair of stereo input 
signals, according to another embodiment of the invention. 



[0023] Figure 1C is a block diagram of a monophonic input circuit for an 
audio enhancennent system for generating an enlianced monaural image from a 
monophonic input signal, according to an embodiment of the invention. 

[0024] Figure 2 is a graphical representation of the magnitude response of 
an enhancement cun/e according to an embodiment of the invention. 

[0025] Figure 3 is a graphical representation of the phase response of an 
enhancement curve according to an embodiment of the invention. 

[0026] Figure 4 is a graphical representation of a system magnitude 
response to unity input on the left channel and no input on the right channel, 
according to an embodiment of the invention. 

[0027] Figure 5 is a graphical representation of a system phase response 
to unity input on the left channel and no input on the right channel, according to an 
embodiment of the invention. 

[0028] Figure 6 is a graphical representation of a system magnitude 
response to no input on the left channel and unity input on the right channel, 
according to an embodiment of the invention. 

[0029] Figure 7 is a graphical representation of a system phase response 
to no input on the left channel and unity input on the right channel, according to an 
embodiment of the invention. 

[0030] Figure 8 is a graphical representation of a difference in phase 
response between the phase response of Figure 5 and the phase response of 
Figure 7, according to an embodiment of the invention. 

[0031] Figure 9 is a graphical representation of the magnitude response of 
an enhancement curve, according to an embodiment of the invention. 

[0032] Figure 10 is a graphical representation of the phase response of an 
enhancement curve, according to an embodiment of the invention. 

[0033] Figure 11 is a graphical representation of a difference in phase 
response between a system phase response to unity input on the left channel and 
no input on the right channel, and a system phase response to no input on the left 
channel and unity input on the right channel, before phase adjustment, according to 
an embodiment of the invention. 
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[0034] Figure 12 is a graphical representation of a system magnitude 
response to no input on the left channel and unity input on the right channel, before 
phase adjustment, according to an embodiment of the invention. 

[0035] Figure 13 is a graphical representation of the phase response of a 
phase adjustment curve, according to an embodiment of the invention. 

[0036] Figure 14 is a graphical representation of a difference in phase 
response between a system phase response to unity input on the left channel and 
no input on the right channel, and a system phase response to no input on the left 
channel and unity input on the right channel, after phase adjustment, according to 
an embodiment of the invention. 

[0037] Figure 15 is a graphical representation of a system magnitude 
response to unity input on the left channel and no input on the right channel, 
according to an embodiment of the invention. 

[0038] Figure 16 is a graphical representation of a system magnitude 
response to no input on the left channel and unity input on the right channel, 
according to an embodiment of the invention. 

Detailed Description of the Preferred Embodiment 
[0039] An audio enhancement system combines stereophonic input 
signals to generate a monaural output signal with enhanced spatial characteristics. 
To avoid the loss of signal information that occurs when the stereo input signals are 
merely added, in one embodiment the audio enhancement system adjusts the 
phase of the signals. Phase adjustment is used to modify the frequency response 
of the system at frequencies where the system responses have approximately equal 
amplitudes and opposite phases. The adjustment at these frequencies avoids 
potential cancellation of information and preserves the original audio fidelity. 

[0040] In one embodiment, the stereophonic information is processed to 
create an enhanced spatial impression when the information from different channels 
is combined to create a monophonic output. For example, an embodiment of the 
invention uses spatial enhancement to enhance the reproduction of stereo sound on 
a television having a monophonic audio output. 
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[0041] In an embodiment, for example, to enhance the reproduction of 
stereo sound on a television having a single speaker, the audio enhancement 
system determines the difference information that exists between different 
stereophonic channels. An enhancer then enhances the difference information to 
create an enhanced spatial impression. The enhancer can be a filter, such as a 
perspective filter, a band-pass filter, a high-pass filter, a low-pass filter, an all-pass 
filter, a gain, a filter and a gain, a delay, or the like. In an embodiment, the gain of 
the enhanced difference information is adjusted. In addition, a combiner combines 
the stereophonic channels to generate a sum signal. A mixer combines the 
enhanced difference information with the sum signal to generate an enhanced 
monophonic output. The result is a restoration of detail and the impression that the 
sound source is much larger when the sound is reproduced. 

[0042] The sum and difference information need not be created prior to 
enhancing the signals, but can be created in the mixer. In another embodiment, an 
enhancer enhances the stereophonic channel inputs. The enhanced stereophonic 
information is mixed with the original stereophonic information to generate an 
enhanced monophonic output. In an embodiment, intermediate steps in the mixer 
generate the sum and difference information. A digital signal processor, for 
example, can implement the mixer. 

[0043] In another implementation, the invention phase shifts the signals to 
preserve audio information that potentially could be lost when the signals combine to 
create the output. In an embodiment, for example, to enhance the reproduction of 
stereo sound on a cell phone speaker, the audio enhancement system extracts the 
difference information from the stereophonic input. An enhancer enhances the 
difference signal to create an enhanced spatial impression. The enhancer can be a 
filter, such as a perspective filter, a band-pass filter, a high-pass filter, a low-pass 
filter, an all-pass filter, or the like, a gain, a filter and a gain, a delay, or the like. In 
an embodiment, a gain control device adjusts the gain of the enhanced difference 
information. A combiner then generates the sum or monophonic information from 
the stereophonic signal and a phase adjuster adjusts the phase of the monophonic 
information. The phase adjuster can be a filter, such as a perspective filter, a 
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lagging filter, a leading filter, a band-pass filter, a high-pass filter, a low-pass filter, 
an all-pass filter, or the like. The audio enhancement system combines the phase 
adjusted monophonic Information and the enhanced difference information to 
produce the monophonic output. 

[0044] In other embodiments, the phase adjuster adjusts the phase of the 
difference information. The audio enhancement system combines the monophonic 
information and the phase adjusted enhanced difference information to produce the 
monophonic output. 

[0045] In further embodiments, the phase adjuster adjusts both the sum 
and the difference information, using, for example, a leading and a lagging filter, or 
the like. The audio enhancement system combines the phase adjusted monophonic 
information with the phase adjusted difference information to produce the 
monophonic output. 

[0046] In yet other embodiments utilizing a phase adjustment, the sum 
and difference information need not be created prior to enhancing the signals, but 
can be created as intermediate steps in the mixer. A digital signal processor, for 
example, can implement the mixer. The audio enhancement system phase adjusts 
either stereophonic channel input or both stereophonic channel inputs. In addition, 
the enhancer enhances the stereophonic channel inputs. 

[0047] In the embodiment where both input channels are phase adjusted, 
the audio enhancement system combines the phase adjusted stereophonic signals 
and the enhanced stereophonic information to produce the monophonic output. 

[0048] In the embodiment where only one stereophonic input channel is 
phase adjusted, the audio enhancement system combines the phase adjusted 
stereophonic signal, the other original stereophonic signal, and the enhanced 
stereophonic channel information to produce the monophonic output. 

[0049] In other embodiments, the stereo input signals are synthetically 
generated from a monaural input. The monophonic input information is processed 
to create an enhanced spatial impression. One approach delays information in the 
monaural input signal so that a spatial impression is created when the delayed 
information is combined with the original monaural signal to create the output. 



-8- 



[0050] In an embodiment to create a spatially enhanced monophonic 
output from a monophonic input signal, the audio enhancement system determines 
the difference information that exists between the monophonic input and the 
delayed monophonic input. An enhancer enhances the difference information to 
create a spatial impression. In addition, a combiner combines the monophonic input 
and the delayed monophonic input to generate a sum signal. In an embodiment, a 
gain control device adjusts the gain of the enhanced difference information. A mixer 
combines the enhanced difference information with the sum signal to generate an 
enhanced monophonic output. The result is the impression that the sound source is 
much larger when the sound is reproduced. 

[0051] As summarized above, one embodiment of the invention comprises 
an audio enhancement system which generates a single audio output channel from 
two or more audio input channels, such that portions of the ambience present in the 
input channels are preserved in the output channel. For convenience and clarity of 
presentation, the discussion which follows assumes the input channels comprise 
stereophonic left and right channels and the audio enhancement system provides a 
single output. 

[0052] The input, however, need not be limited to two stereo channels and 
embodiments of the invention can be used in many applications where the 
ambience of reproduced sound is produced by generating an output channel from a 
plurality of input channels. Furthermore, embodiments of the invention can be used 
in applications where the ambience of reproduced sound is produced by generating 
an output channel from at least one input channel. In addition, the input signals can 
comprise analog information or digital information, or the like. The output signal can 
also comprise analog information or digital information, or the like. 

[0053] For a more detailed understanding of the invention, reference is 
first made to Figure 1A. Figure 1A illustrates an audio enhancement system 100 in 
accordance with an embodiment of the invention. A first input of a differencing 
device 118 receives a left input, Lin, 112 and a second input of the differencing 
device 118 receives a right input, Rin. 1 14. 
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[0054] The differencing device 118 produces a difference signal (L-R), 
which represents the spatial or ambient component of the stereo input signals, Lin 
and RiN. In an embodiment, the differencing device 118 comprises a subtractor. In 
another embodiment, the differencing device 118 comprises a combiner. 

[0055] As further illustrated in Figure 1A. an output of the differencing 
device 118 provides an input to an enhancer 120. 

[0056] The enhancer 120 receives the spatial component (L-R) of the 
signal. The enhancer 120 enhances the spatial characteristics of the signal. In one 
embodiment, the enhancer 120 broadens and blends a perceived sound stage from 
the audio input information by selectively enhancing the sound information that 
provides a sense of spaciousness. The enhancer 120 produces an enhanced 
difference component (L-R)enhanced- 

[0057] In an embodiment of the invention, the enhancer 120 comprises a 
perspective filter. In other embodiments of the invention, the enhancer 120 
comprises a band-pass filter, an all-pass filter, a high-pass filter, a low-pass filter, or 
the like. In yet further embodiments of the invention, the enhancer 120 comprises a 
gain, a filter and a gain in series, a delay, or the like. An output of the enhancer 
1 20 provides a first input to a mixer 1 24. 

[0058] As illustrated in Figure 1A, a first input of a summing device 116 
receives the left input, Lin, 112 and a second input of the summing device 116 
receives the right input, Rin, 114. 

[0059] The summing device 116 produces a sum signal, L+R, which 
represents the direct or monaural component of the stereo input signals, Lin and Rin- 
In an embodiment, the summing device 116 comprises an adder. In another 
embodiment, the summing device 116 comprises a combiner. An output of the 
summing device 116 provides an input to an enhancer 122. 

[0060] The enhancer 122 phase adjusts the sum signal relative to the 
difference signal to preserve audio information. This audio information could 
potentially be canceled and lost when the mixer 124 combines the signals. The 
enhancer 122 produces a phase adjusted sum component (L+R)enhanced- 
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[0061] In an embodiment of the invention, the enhancer 122 comprises an 
all-pass filter. In other embodiments of the invention, the enhancer 122 comprises a 
band-pass filter, a high-pass filter, a low-pass filter, a leading filter, a lagging filter, or 
the like. 

[0062] An output of the enhancer 1 22 provides a second input to the mixer 
124 and, as described above, the output of the enhancer 120 provides the first input 
to the mixer 124. An output of the mixer 124 is an enhanced monophonic output 
126. 

[0063] The mixer 124 combines the enhanced difference component (L- 
R)enhanced with the phase adjusted direct component (L+R)enhanced to produce the 
monaural output 126 with enhanced spatial impression. 

[0064] Depending on the enhancer 120 used in the audio enhancement 
system ICQ, as discussed previously, the system may need or may not need phase 
adjustment. In embodiments of the audio enhancement system 100 that do not 
need phase adjustment, the enhancer 122 is removed. The output of the summing 
device 116 provides the second input to the mixer 124. The mixer 124 combines 
the enhanced difference component (L-R)enhanced with the direct component (L+R) to 
produce the monaural output 126 with enhanced spatial impression. 

[0065] Figure IB illustrates an audio enhancement system 140 in 
accordance with an embodiment of the invention. The audio enhancement system 
140 does not create the sum and difference information prior to mixing the signals, 
as illustrated in the audio enhancement system 100 of Figure 1A. In the audio 
enhancement system 140, an enhancer 144 receives the left input, Lin, 112. The 
enhancer 144 selectively enhances the sound information in the left input, Lin, 112 
that provides a sense of spaciousness. The enhancer 144 produces an enhanced 
left channel signal, Lenhanced- 

[0066] In an embodiment of the invention, the enhancer 144 comprises a 
perspective filter. In other embodiments of the invention, the enhancer 144 
comprises a band-pass filter, an all-pass filter, a high-pass filter, a low-pass filter, or 
the like. In yet further embodiments of the invention, the enhancer 144 comprises a 
gain, a filter and a gain in series, a delay, or the like. 
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[0067] An output of the enhancer, Lenhanced 144, provides a first input to a 
mixer 152. 

[0068] Referring to Figure 1B. an enhancer 146 receives the right input, 
RiN, 114. The enhancer 146 selectively enhances the sound information in the right 
input, RiN. 114 that provides a sense of spaciousness. The enhancer 146 produces 
an enhanced right channel signal, Renhanced- 

[0069] In an embodiment of the invention, the enhancer 146 comprises a 
perspective filter. In other embodiments of the invention, the enhancer 146 
comprises a band-pass filter, an all-pass filter, a high-pass filter, a low-pass filter, or 
the like. In yet further embodiments of the invention, the enhancer 146 comprises a 
gain, a filter and a gain in series, a delay, or the like. 

[0070] An output of the enhancer 146 provides an input to an inverter 148. 
The inverter 148 inverts the enhanced right channel signal Renhanced to produce an 
inverted right channel signal Rmverted. The output of the inverter 148 provides a 
second input to the mixer 152. 

[0071] Again referring to Figure IB, an enhancer 142 receives the left 
input, LiN, 112. The enhancer 142 phase adjusts the left input, Lin, 112 relative to 
the right input Rin, 114 to preserve audio information. This audio information could 
potentially be canceled and lost when the mixer 152 combines the signals. The 
enhancer 142 produces a phase adjusted left input signal l-adjusted* 

[0072] In an embodiment of the invention, the enhancer 142 comprises an 
all-pass filter. In other embodiments of the invention, the enhancer 142 comprises a 
band-pass filter, a high-pass filter, a low-pass filter, a leading filter, a lagging filter, or 
the like. An output of the enhancer 142. Ladjustedi provides a third input to the mixer 
152. 

[0073] Again referring to Figure IB. an enhancer 150 receives the right 
input, RiN, 1 14. The enhancer 150 phase adjusts the right input, Rin. 1 14 relative to 
the right input Lin, 112 to preserve audio information. This audio information could 
potentially be canceled and lost when the mixer 152 combines the signals. The 
enhancer 150 produces a phase adjusted right input signal rvadjusled- 
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[0074] In an embodiment of the invention, the enhancer 1 50 comprises an 
all-pass filter. In other embodiments of the invention, the enhancer 150 comprises a 
band-pass filter, a high-pass filter, a low-pass filter, a leading filter, a lagging filter, or 
the like. An output of the enhancer 150, Radjusted. provides a fourth input to the mixer 
152. 

[0075] The mixer 1 52 receives the phase adjusted and enhanced left and 
right channel signals. The mixer 152 combines the enhanced left and right signals, 
Lenhanced and Rjnverted With the phase adjusted left and right signals, Ladjusted and 
Radjusted to produce the monaural output 126 with enhanced spatial impression. 

[0076] Depending on the enhancers 144, 146 used in the audio 
enhancement system 140, as discussed previously, the system may need or may 
not need phase adjustment to prevent a loss of audio information. In embodiments 
of the audio enhancement system 140 that do not need phase adjustment, the 
enhancers 142, 150 are removed. The left input signal, Lin, 112 provides the third 
input to the mixer 152 and the right input, Rin, 114 provides the fourth input to the 
mixer 152. The mixer 152 combines the enhanced left and right signals, l-enhanced 
and Rjnverted With the left and right input signals, Lin, 112 and Rin, 1 14 to produce the 
monaural output 126 with enhanced spatial impression. 

[0077] Referring to Figures 1A and IB, the audio enhancement systems 
100 and 140 can be combined with other audio enhancement systems, such as, for 
example, bass enhancement systems, as described in U.S. Patent No. 6,285,767, 
the entirety of which is hereby incorporated herein by reference. The enhancers 
120, 122, 142, 144, 146, 150 can comprise additional audio enhancement 
techniques, such as, for example, height, width and depth perception enhancement. 
Such techniques, for example, are described in U.S. Patent Nos. 4,748,669, 
4.866,774, 5,661,808, 5,892,830, 6,597,791. 5,970,152, 6,281,749, and U.S. Patent 
Application No. 09/411,143, the entirety of which are hereby incorporated herein by 
reference. 

[0078] Figure 1C illustrates a monophonic input circuit 180 for the audio 
enhancement system 100, 140 for generating an enhanced monaural image from a 
monophonic input signal, according to an embodiment of the invention. A delay 



-13- 



device 184 receives a monophonic input, MONOin, 182. The delay device 184 
delays the monaural input signal. MONOin. 182 to provide a delayed monaural 
signal, which is also a left pseudo-stereophonic output signal Lpseudo. 186. In an 
embodiment, the delay is approximately 20 ms. In another embodiment, the delay 
may be more or less than 20 ms while still preserving the functional aspects of the 
invention. The monophonic input, MONOin. 182 also provides a right pseudo- 
stereophonic output signal, Rpseudo, 188. 

[0079] The output signals, Lpseudo, 186 and Rpseudo. 188 provide input 
signals to the audio enhancement systems 100, 140 in place of the input 
stereophonic signals, Un, 112 and Rin, 114. Thus, the audio enhancement systems 
100, 140 in combination with the monophonic input circuit 180 generate spatially 
enhanced monaural audio information from a monophonic input signal. 

[0080] In an embodiment of the invention, the audio enhancement system 
100, 140 can be combined with other systems for generating pseudo-stereophonic 
outputs from a monophonic input, such as, for example, the audio enhancement 
systems described in U.S. Patent Nos. 4,841,572 and 6,590,983, the entirety of 
which are hereby incorporated herein by reference. 

[0081] In another embodiment of the invention, the audio enhancement 
system 100, 140, 180 can be combined with other audio enhancement systems to 
provide additional audio enhancement effects, such as, for example, those audio 
enhancement systems described in U.S. Patent Nos. 4,819,269, 4,836,329, 
5,319,713, 5,333,201. 5,459,813, 5,638.452, 5.771,295, 5,784.468. 5,850.453, 
5,912,976, the entirety of which are hereby incorporated herein by reference. 

[0082] In an embodiment, discrete circuit components implement the 
audio enhancement system 100, 140, or 180. In an additional embodiment, the left 
112 and right 114 stereo input signals are part of an audio-visual composite signal. 
In another embodiment, the audio enhancement system 100, 140. or 180 is 
constructed as a digital and analog hybrid circuit. In yet another embodiment, the 
audio enhancement system 100, 140, or 180 is contained within a multi-chip 
module. 
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[0083] In another embodiment of the invention, a digital signal processor 
(DSP) implements the audio enhancement system 100, 140, or 180 in digital format. 
In another embodiment, a computer implements the audio enhancement system 
100. 140, or 180 in software. 

[0084] The computers comprise, by way of example, processors, program 
logic, or other substrate configurations representing data and instructions, which 
operate as described herein. In other embodiments, the processors can comprise 
controller circuitry, processor circuitry, processors, general purpose single-chip or 
multi-chip microprocessors, digital signal processors, embedded microprocessors, 
microcontrollers and the like. 

[0085] In an embodiment, the software may advantageously be 
implemented as one or more modules. The modules may advantageously be 
configured to execute on one or more processors. The modules may comprise, but 
are not limited to, any of the following: software or hardware components such as 
software object-oriented software components, class components and task 
components, processes methods, functions, attributes, procedures, subroutines, 
segments of program code, drivers, firmware, microcode, circuitry, data, databases, 
data structures, tables, arrays, or variables. 

[0086] The audio enhancement systems 100, 140, 180 of Figures 1A, IB, 
and 1C generate enhanced audio information for reproduction on a single speaker. 
One can imagine many different speakers, each one with different speaker 
characteristics. There are many different enhancers 120, 122-, 142, 144, 146, 150 
with different characteristics to enhance the stereophonic inputs or pseudo- 
stereophonic inputs for reproduction on the variety of speakers. 

[0087] Figures 2-8 illustrate the enhancer characteristics and system 
response characteristics for one embodiment of the audio enhancement system 
100. In this example, the audio enhancement system 100 generates enhanced 
audio for reproduction on an average sized speaker for a monophonic television set. 
The television set speaker parameters, in this embodiment, are such that the audio 
enhancement system 100 does not require phase adjustment of the enhanced 
audio. Referring again to Figure 1A, the audio enhancement system 100 does not 
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include the enhancer 122. The output of the summing device 116 provides the first 
input to the mixer 124 and enhancer 120 comprises a filter. 

[0088] Figure 2 is a graphical representation of a range of magnitude 
responses 200, 202. 204 of an enhancement curve of the filter 120, according to an 
embodiment of the audio enhancement system 100 that will be hereafter referred to 
as the "television embodiment." However, such reference is made only to provide a 
general idea of the speaker size suitable for this embodiment and not to imply that 
the embodiment is suitable only for a television. The same television embodiment is 
suitable for other consumer products and other applications as well. Figure 2 shows 
the frequency in Hertz (Hz) on the x-axis and the amplitude in decibels (dB) on the 
y-axis. In one embodiment, the magnitude response range 202, 204 peaks between 
approximately 0 dB to approximately 20 dB in a mid-band frequency range. 

[0089] In more detail, magnitude response range 202, 204 peaks between 
approximately 0 dB to approximately 20 dB at frequencies of between approximately 
1 kHz to approximately 5 kHz. In further detail, the magnitude response 200 has an 
amplitude of approximately -18 dB at approximately 30 Hz and crosses 0 dB at 
approximately 260 Hz. The amplitude ramps up at approximately 19 dB per decade 
to a peak of approximately 9.5 dB at approximately 1 .8 kHz. The amplitude rolls off 
at approximately 20 dB per decade to approximately -18 dB at approximately 20 
kHz and crosses 0 dB at approximately 10 kHz. 

[0090] Figure 3 is a graphical representation of a range of phase 
responses 300, 302, 304 of the enhancement curve of the filter 120 according to the 
television embodiment of the audio enhancement system 100. Figure 3 shows the 
frequency in Hertz on the x-axis and the phase angle in degrees on the y-axis. In 
this embodiment, the phase response range 302, 304 has a phase angle of between 
approximately -180"* to approximately 20° for low frequencies, between 
approximately -160° to approximately 150° for mid-band frequencies, and between 
approximately -70° to approximately 200° for high frequencies. 

[0091] In more detail, the phase response range 302, 304 has a phase 
angle of between approximately -180° to approximately 20° at frequencies of 
between approximately 20 Hz to approximately 300 Hz. The phase angle is 
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between approximately -180° to approximately 150° at frequencies of between 
approximately 300 Hz to approximately 4 kHz and continues to rise to between 
approximately -100° to approximately 200° at frequencies of between approximately 
4 kHz to approximately 20 kHz. In further detail, the phase response 300 has a 
phase angle of approximately -90° at frequencies of between approximately 20 Hz 
to approximately 300 Hz. The phase response 300 rises to approximately 30° at 
approximately 3 kHz and continues to rise to approximately 80° at approximately 20 
kHz at a rate of approximately 60° per decade. 

[0092] In this example, the parameters of the enhancer 120 are chosen to 
enhance the audio for reproduction on a monophonic television set speaker. The 
circuit is designed such that the amplitude response of enhancer 120 is not 0 dB at 
the same frequency that the phase response is 0° or 180°. Othenwise, referring 
back to Figure 1A, cancellation of some audio information may occur, for example, if 
no information is present at one of the Lin or Rin signal inputs. Referring to Figures 
2 and 3, the amplitude of the filter response 200 is not approximately 0 dB in the 
same frequency range that the phase response 300 is approximately 0° or 180°. In 
addition to enhancing the audio, the filter does not disadvantageously shift the 
phase relationship of the audio signal. The audio enhancement system 100 
preserves the audio information across the frequency spectrum. Figures 4 and 6 
further illustrate the preservation of audio information for the television embodiment 
of the audio enhancement system 100. 

[0093] Figure 4 illustrates a range of acceptable magnitude responses 
400, 402, 404 to a unity input on the left channel 112 and no input on the right 
channel 114 for the television embodiment of the audio enhancement system 100. 
In this embodiment, the audio enhancement system 100 comprises the filter 120 as 
characterized in Figures 2 and 3. The magnitude response range 402. 404 of 
Figure 4 peaks at between approximately -3 dB to approximately 20 dB at 
frequencies of between approximately 1 kHz to approximately 3 kHz. In further 
detail, the magnitude response 400 of Figure 4 has an amplitude of approximately - 
6 dB at approximately 20 Hz and crosses 0 dB at approximately 200 Hz. The 
amplitude 400 ramps up at approximately 13 dB per decade to a peak of 
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approximately 11 dB at approximately 1.8 l<Hz. The amplitude 400 rolls off at 
approximately 18 dB per decade to approximately -6 dB at approximately 20 kHz 
and crosses 0 dB at approximately 12 kHz. 

[0094] Figure 5 illustrates a range of acceptable phase responses 500, 
502, 504 to a unity input on the left channel 112 and no input on the right channel 
114 for the television embodiment of the audio enhancement system 100. In this 
embodiment, the audio enhancement system 100 comprises the filter 120 as 
characterized in Figures 2 and 3. The phase response range 502, 504 of Figure 5 
has a minimum phase angle of between approximately -200® to approximately 100° 
at frequencies between approximately 50 Hz to approximately 1 kHz and a 
maximum phase angle of between approximately -100° to approximately 200° at 
frequencies of between approximately 5 kHz to approximately 20 kHz. In further 
detail, the phase response 500 is approximately -10° at approximately 20 Hz and 
drops to approximately -50° at approximately 300 Hz at a rate of approximately -45° 
per decade. The phase response 500 then increases to approximately 50° at 
approximately 10 kHz at a rate of approximately 90° per decade and crosses 0° at 
approximately 1 .9 kHz. The phase response 500 then drops to approximately 20° at 
approximately 20 kHz at a rate of approximately 1 80° per decade. 

[0095] Figure 6 Illustrates an acceptable magnitude response range 600, 
602, 604 to a unity input on the right channel 114 and no input on the left channel 
112 for the television embodiment of the audio enhancement system 100. In this 
embodiment, the audio enhancement system 100 comprises the filter 120 as 
characterized in Figures 2 and 3. The magnitude response range 602, 604 of 
Figure 6 peaks at between approximately -6 dB to approximately 20 dB at 
frequencies of between approximately 1 kHz to approximately 3 kHz. In further 
detail, the magnitude response 600 has an amplitude of approximately -6 dB at 
approximately 20 Hz and crosses 0 dB at approximately 290 Hz. The amplitude 600 
ramps up at approximately 14 dB per decade to a peak of approximately 8 dB at 
approximately 1.6 kHz. The amplitude 600 rolls off at approximately 18 dB per 
decade to approximately -6 dB at approximately 20 kHz and crosses 0 dB at 
approximately 1 0 kHz. 
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[0096] Figure 7 illustrates a range of acceptable phase responses 700, 
702, 704 to a unity input on the right channel 114 and no input on the left channel 
112 suitable for the television embodiment of the audio enhancement system 100. 
In this embodiment, the audio enhancement system 100 comprises the filter 120 as 
characterized in Figures 2 and 3. The phase response range 702, 704 of Figure 7 
has a range of phase angles between approximately 0° to approximately 80° at 
frequencies of between approximately 20 Hz to approximately 300 Hz, between 
approximately 60® to approximately 180° at frequencies of between approximately 
300 Hz to approximately 2 kHz, and between approximately 180° to approximately 
360° at frequencies of approximately 2 kHz to approximately 20kHz. In further 
detail, the phase angle 700 is approximately 10"* at approximately 20 Hz and rises to 
approximately 180'' at approximately 1.7 kHz at a rate of approximately 100"" per 
decade. The phase angle continues to rise to approximately 360'' at approximately 
1 .7 kHz at a rate of approximately 1 35** per decade. 

[0097] The responses 400 and 600 of Figures 4 and 6, respectively, show 
no frequencies with substantial signal attenuation across the frequency spectrum. 
As discussed previously, this is due to the parameters of the filter 120. As shown in 
Figures 2 and 3, the filter response curves 200 and 300 do not exhibit frequency 
responses having points at which the magnitude 200 is approximately 0 dB at the 
same frequencies where the phase angle 300 is either approximately 0° or 180°. 

[0098] Again referring to Figures 4 and 6, the system magnitude 
responses 400 and 600 have similarly shaped curves over the frequency spectrum. 
In this embodiment, the audio enhancement system 100 has approximately equal 
gain in the left and right channel paths to preserve the original balance between the 
LiN and Rin signals. In other embodiments, the gains of the left and right channel 
paths may have more unequal gains. 

[0099] Figure 8 illustrates a phase difference 800 between the phase 
response 500 of Figure 5 and the phase response 700 of Figure 7. That is. Figure 8 
shows the phase angle 800 at the output 126 between an input on the left channel 
112 with no input on the right channel 114, and an input on the right channel 114 
with no input on the left channel 112. As shown in Figure 8, the phase angle does 
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not approach 0* across the full audio spectrum from 20 Hz to 20 kHz indicating that 
audio infonnation in the input channels will not be lost in the audio enhancement 
system 100 from phase cancellation. 

[0100] In further detail, the phase difference 800 is approximately -20° at 
approximately 20 Hz and drops to approximately -180° at approximately 1.7 Hz at a 
rate of approximately 115° per decade. At approximately 1.7 kHz the phase 
difference between the left and right channels is approximately 180°. At the same 
frequency, however, the overall circuit 100 has a gain greater than 0 dB preserving 
information at the 1.7 kHz range that might otherwise be cancelled from out of 
phase mixing at the output stage. The phase difference 800 further drops to 
approximately -360° at approximately 20 kHz. 

[0101] Referring to Figures 1A, IB, and 1C, one can again imagine many 
different speakers, each one with different speaker characteristics. As discussed 
previously, there are many different enhancers 120, 122, 142, 144, 146, 150 with 
different characteristics to enhance the stereophonic inputs or pseudo-stereophonic 
inputs for reproduction on the variety of speakers. 

[01 02] Figures 9 and 1 0 illustrate the enhancer characteristics of enhancer 
120 for one embodiment of the audio enhancement system 100. In this example, 
the audio enhancement system 100 generates enhanced audio for reproduction on 
a cellular telephone. The enhancer 120 in this embodiment comprises a 
perspective filter 120. The parameters of the filter 120 are chosen to enhance audio 
for reproduction of the cell phone speaker. 

[0103] Figure 9 is a graphical representation of a range of magnitude 
responses 900, 902, 904 of an enhancement curve of the filter 120, according to 
one embodiment of the cell phone implementation of the invention. In this 
embodiment, the magnitude response range of the magnitude responses 902, 904 
peaks between approximately -15 dB to approximately 10 dB in a mid-band 
frequency range. 

[0104] In further detail, the magnitude response 900 has an amplitude of 
approximately -30 dB at approximately 250 Hz and ramps up at approximately 23 
dB per decade to approximately -10 dB at approximately 2 kHz. The magnitude 
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response 900 rises to a peak of approximately 2 dB at approximately 3.5 kHz, drops 
to a minimum of approximately -4.5 dB at approximately 4 kHz. The magnitude 
response 900 rises to a peak of approximately 0 dB at approximately 5 kHz and 
drops to a minimum of approximately -5 dB at approximately 6.4 kHz. The 
magnitude response rises to a peak of approximately 2 dB at a frequency of 
approximately 7.7 kHz and drops to approximately -27 dB at approximately 20 kHz 
at a rate of approximately 64 dB per decade. 

[0105] Figure 10 is a graphical representation of a range of phase 
responses 300, 302, 304 of the enhancement curve of the filter 120 according to 
one embodiment of cell phone implementation of the invention. In this embodiment, 
the range of the phase responses 1002, 1004 has a phase angle of between 
approximately -200° to approximately 30" at frequencies of between approximately 
20 Hz to approximately 3 kHz. The phase angle is between approximately -180° to 
approximately 200° at frequencies of between approximately 3 kHz to approximately 
20 kHz. In further detail, the phase response 1000 has a phase angle of 
approximately -90° at frequencies of between approximately 20 Hz to approximately 
300 Hz. The phase response 1000 rises to approximately 30° at approximately 3 
kHz, continues to rise to a peak of approximately 0° at approximately 3.5 kHz and 
drops to a minimum of -20° at approximately 4.5 kHz. The phase response 1000 
rises to a peak of approximately 25° at approximately 6 kHz and drops to 
approximately 0 dB at approximately 7 kHz. The phase response 1000 rises to 
approximately 90° at approximately 20 kHz. 

[0106] In this example, the parameters of the filter 120 are chosen to 
enhance the audio for reproduction on a cell phone speaker. Referring to Figures 9 
and 10, it can be seen that the amplitude of the filter response 900 is approximately 
0 dB in the same frequency range that the phase response 1000 is approximately 
0°. In addition to enhancing the audio, the filter 120 shifts the phase of the 
enhanced difference signal in this embodiment. If uncorrected, a loss of audio 
information occurs at the frequencies where the filter magnitude response is 
approximately 0 dB and the filter phase response is approximately 0°. Figures 1 1 
and 12 illustrate the loss of audio information when the embodiment of the audio 
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enhancement system 100 for the cell phone does not adjust the relative phase of 
the enhanced signals. 

[0107] Figure 11 illustrates a difference in phase response 1100 between 
the left channel phase response and the right channel phase response without the 
enhancer 122 for one embodiment of the cell phone implementation of the audio 
enhancement system 100. That is, Figure 11 shows the phase response difference 
at the output 126 between the phase response generated by a unity input on the left 
channel 112, Lin and no input on the right channel 1 14, Rin and the phase response 
generated by no input on the left channel 112, Lin and a unity input on the right 
channel114, RiN. 

[0108] The audio enhancement system utilized to generate the phase 
response difference 1 100 is an embodiment of the audio enhancement system 100 
with the filter 120 as described in Figures 9 and 10 and without the enhancer 122. 
Thus, the audio enhancement system 100 without the enhancer 122 does not 
separately adjust the overall relative phase of the enhanced signals. 

[0109] As shown in Figure 11, the phase difference 11 00 is approximately 
0° at approximately 3.6 kHz, approximately 5.1 kHz, and approximately 7 kHz in the 
cell phone embodiment of the audio enhancement system 100 without the enhancer 
122. Referring again to Figure 1 A, if the output of the summing device 116 and the 
enhancer 120 are combined in mixer 124, cancellation of the audio information can 
occur where the phase difference is approximately 0°. In this embodiment, the 
audio information is lost at approximately 3.6 kHz, 5.1 kHz, and 7 kHz. Accordingly, 
at the points where the phase difference is approximately 0°, the monophonic output 
126 may lose at least a portion of the spatial content of the difference information 
from cancellation at the mixer 126. 

[0110] The attenuation of the audio signal at approximately 3.6 kHz, 5.1 
kHz, and 7 kHz is also shown in Figure 12. Figure 12 illustrates a magnitude 
response 1200 from no input on the left channel 112 and a unity input on the right 
channel for the embodiment of the audio enhancement system 100 for use in a cell 
phone with no phase adjustment. In this embodiment, the magnitude response 
range 1200 of Figure 12 is flat at frequencies of between approximately 20 Hz to 
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approximately 3 kHz and between approximately 9 kHz to approximately 20 kHz. At 
frequencies between approximately 3 kHz to approximately 9 kHz, the amplitude is 
attenuated. 

[0111] In further detail, the magnitude response 1200 of Figure 12 has an 
amplitude of approximately 0 dB at frequencies of approximately 20 Hz to 
approximately 3 kHz. The magnitude response 1200 drops considerably in 
magnitude as shown at approximately 3.6 kHz, approximately 5.1 kHz, and at 
approximately 7 kHz. Without correction, a substantial loss of audio information can 
occur at these frequencies due to the frequency response of the enhancer 120 
designed to correspond to the cell phone speaker characteristics. 

[0112] In addition, the cell phone embodiment of the audio enhancement 
system 100 is designed to keep the magnitude response of the inputs symmetrical, 
i.e., approximately equal, to prevent one input signal from ovenwhelming the other 
input signal. However, when the enhanced signals having opposite phase and 
nearly equal magnitude are added, certain information present in the signals may 
cancel. 

[0113] To avoid losing audio information when the sum and difference 
signals are combined to generate the enhanced monaural output 126, embodiments 
of the audio enhancement systems 100, 140 comprise the enhancer 122, 142, 
and/or 150 to adjust the phase of the sum signal. As discussed previously, to 
prevent audio signal cancellation loss, other embodiments of the audio 
enhancement system 100, 140 can adjust the phase of the sum signal, the 
difference signal, the sum and difference signals, the enhanced difference signal, or 
the input signals. What is important is ensuring the proper relative phase of the 
signal paths which can be accomplished by modifying one or, as shown in Figures 
1A and 1B, by modifying both of the signal paths. 

[0114] Figure 13 illustrates the phase characteristics of the phase 
adjustment enhancer 122 used for the cell phone embodiment. In this embodiment, 
enhancer 122 comprises an all-pass filter, as characterized by Figures 9 and 10. 
The output of the filter 122 provides the first input to the mixer 124 and the output of 
filter 120 provides the second input to the mixer 124. 
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[0115] Figure 13 illustrates a range of acceptable phase-versus-frequency 
responses 1300. 1302, 1304 of the filter 122. In this embodiment, the range of 
phase angles 1302, 1304 of Figure 13 is between approximately -200** to 
approximately -60° for low frequencies, between approximately -200° to 
approximately 20° for mid-band frequencies, and between approximately -120° to 
approximately 110° for high frequencies. 

[0116] In further detail, the phase angle 1300 of Figure 13 is between 
approximately -180° to approximately -100° for frequencies of between 
approximately 20 Hz to approximately 3 kHz. The phase angle 1300 is between 
approximately -1 50° to approximately 0° for frequencies of between approximately 1 
kHz to approximately 20 kHz. 

[0117] The magnitude-versus-frequency response of the all-pass filter 122 
used in the cell phone embodiment of the audio enhancement system 100 is flat 
across the frequency spectrum, from 20 Hz to 20 kHz. An acceptable magnitude 
response range may vary from between -10 dB to 10 dB. 

[0118] In another embodiment, the filter 122 modifies both phase and 
amplitude. In further embodiments of the invention, the filter 122 comprises a band- 
pass filter, a high-pass filter, a low-pass filter, a phase-leading filter, a phase-lagging 
filter, or other devices having phase adjusting characteristics. 

[0119] Referring to Figure 1A. the filter 122 adjusts the direct component 
(L+R) of the stereophonic input relative to the filtered ambient component (L- 
R)enhanced of the stereophonlc input. The filter produces the phase adjusted sum 
signal (L+R)enhanced. As described previously, the output of the enhancer 122 
provides the first input to the mixer 124, and the output of the enhancer 120 
provides the second input to the mixer 124. 

[0120] The mixer 124 combines the enhanced difference component (L- 
R)enhanced wlth the phase adjusted direct component (L+R)enhanced to produce the 
monaural output 126 with enhanced spatial impression. 

[0121] Figure 14 illustrates a range of acceptable differences in phase 
response of the audio enhancement system 100 for use with the cell phone 
speaker. That is, Figure 14 shows the phase response difference 1400. 1402, 1404 
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at the output 126 between the phase response generated by a unity input on the left 
channel 112, Lin and no input on the right channel 114. Rin and the phase response 
generated by no input on the left channel 112, Un and a unity input on the right 
channel 114, Rin. The audio enhancement system 100 In this embodiment 
comprises the all-pass filter 122 as characterized by Figure 13 and the perspective 
filter 120 as characterized in Figures 9 and 10. 

[0122] As shown in Figure 14, in the cell phone embodiment, the range of 
the difference in the phase angle 1402, 1404 Is between approximately 125° to 
approximately 200° at low frequencies, and is between approximately 50° to 
approximately 125° at approximately 3 kHz to approximately 10 kHz. The phase 
response difference further drops to between approximately 0° to approximately 
75°at approximately 20 kHz. 

[0123] As shown in Figure 14, the phase response difference 1400, 1402, 
1404 has a phase angle of greater than 0° and less than 180° across the frequency 
spectrum, from approximately 20 Hz to 20 kHz. This is the result of phase adjusting 
the sum component (L+R) relative to the enhanced difference component (L- 
R)enhanced in filter 122. When the mixer 124 combines the phase adjusted direct 
component (L+R)enhanced and ambient component (L-R)enhanced. phase cancellation of 
the difference information is reduced. The audio enhancement system 100 
preserves the otherwise canceled audio information present in the left and right 
stereophonic input signals. The sound reproduced when the enhanced monophonic 
output 126 drives the cell phone speaker gives the impression that the sound source 
is wider than the speaker. 

[0124] Figure 15 illustrates a range of magnitude responses 1500, 1502, 
1504 of the audio enhancement system 100 to a unity input on the left channel 712 
Lin and no input on the right channel 714 Rin. The audio enhancement system 100 
represented in Figure 15 is the cell phone embodiment with phase adjustment. In 
this embodiment, the amplitude range 1502, 1504 is between approximately -15 dB 
to approximately 5 dB for low frequencies, between approximately -10 dB to 
approximately 15 dB for mid-band frequencies, and approximately -15 dB to 
approximately 12 dB for high frequencies. 
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[0125] Figure 16 illustrates a range of magnitude responses 1600, 1602. 
1604 of the system 100 to no input on the left channel 712 Lin and a unity input on 
the right channel 714 Rin. The audio enhancement system 100 represented in 
Figure 16 is the cell phone embodiment with phase adjustment. In this embodiment, 
the range of amplitudes 1602, 1604 is between approximately -13 dB to 
approximately 8 dB for low frequencies, between approximately -15 dB to 
approximately 15 dB for mid-band frequencies, and approximately -12 dB to 
approximately 12 dB for high frequencies. 

[0126] Referring to Figures 15 and 16, the system magnitude responses 
1500 and 1600, respectively, do not have frequencies with substantial attenuation. 
The cell phone embodiment of the audio enhancement system 100 comprising the 
enhancer 122 and enhancer 120 preserves the audio information that would 
otherwise be lost. 

[0127] In addition, the system magnitude responses 1500 and 1600 have 
similarly shaped curves over the frequency spectrum. In this embodiment, the audio 
enhancement system 100 ideally has approximately equal gain in the left and right 
channel paths. 

[0128] While certain embodiments of the inventions have been described, 
these embodiments have been presented by way of example only, and are not 
intended to limit the scope of the inventions. Indeed, the novel methods and 
systems described herein may be embodied in a variety of other forms; furthermore, 
various omissions, substitutions and changes in the form of the methods and 
systems described herein may be made without departing from the spirit of the 
inventions. The accompanying claims and their equivalents are intended to cover 
such forms or modifications as would fall within the scope and spirit of the 
inventions. 
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